Video Scene Segmentation System Using Audio-visual Features
نویسندگان
چکیده
This work demonstrates a new approach to video temporal segmentation into scenes. The utilized technique is based on an audio-visual extension of the well-known method of the Scene Transition Graph (STG). This multi-modal extension exploits both lowand high-level audio-visual descriptors to construct distinct STGs. These STGs are employed into a probabilistic framework that is used for estimating a confidence value on each shot boundary also being a scene boundary. Finally, the thresholding of these confidence values generates the set of experimentally estimated scene boundaries. In this demo both the scene segmentation outcome and some intermediate features that lead to it are demonstrated.
منابع مشابه
Video Scene Segmentation using Video and Audio Features
In this paper we present a novel algorithm for video scene segmentation. We model a scene as a semantically consistent chunk of audio-visual data. Central to the segmentation framework is the idea of a finite-memory model. We separately segment the audio and video data into scenes, using data in the memory. The audio segmentation algorithm determines the correlations amongst the envelopes of au...
متن کاملAudio-Assisted Scene Segmentation for Story Browsing
Content-based video retrieval requires an effective scene segmentation technique to divide a long video file into meaningful high-level aggregates of shots called scenes. Each scene is part of a story. Browsing these scenes unfolds the entire story of a film. In this paper, we first investigate recent scene segmentation techniques that belong to the visual-audio alignment approach. This approac...
متن کاملScene change detection by audio and video clues
Automatic video scene change detection is a challenging task. Using audio or visual information alone often cannot provide a satisfactory solution. However, how to combine audio and visual information efficiently still remains a difficult issue since there are various cases in their relationship due to the versatility of videos. In this paper, we present an effective scene change detection meth...
متن کاملStatistical Audio-Visual Data Fusion for Video Scene
Automatic video segmentation into semantic units is important in order to organize an effective content-based access to long video. In this work, we focus on the problem of video segmentation into narrative units called scenes—aggregates of shots unified by a common dramatic event or locale. In this work, we derive a statistical video scene segmentation approach that detects scenes boundaries i...
متن کاملVideo Analysis and Summarization at Structural and Semantic Levels
There has been prior work on video scene segmentation using image data alone [24][59]. In [59], the authors derive scene transition graphs to determine scene boundaries. However, cluster thresholds are difficult to set and often have to be manually tuned. In [24], the authors use an infinite, non-causal memory model to segment the video. We refine this idea of memory in our recent work [48], bu...
متن کامل